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BOUNDARY VALUE AND EXPANSION PROBLEMS: ALGEBRAIC 
BASIS OF THE THEORY.* 

By R. D. Cakmichael. 

1. Introduction. — Linear problems in various forms have been central 
i. development of extensive chapters of mathematical analysis. Many 

of the profound phenomena of nature are subject to laws whose expression 
in mathematical form gives rise to fundamental linear problems of several 
kinds. Logically the simplest and historically the first to be treated in 
detail of the linear problems of pure mathematics are those having to do 
with systems of linear algebraic equations. And these hold the place of 
greatest importance both on account of their simplicity and complete 
development and on account of their suggestiveness in other linear problems. 
In fact it is true that a wide and important range of transcendental linear 
problems emerge from a direct consideration of the natural limiting cases 
of algebraic systems under the guidance of current problems of transcen- 
dental analysis. 

The deep-lying connection between algebraic and transcendental prob- 
lems of linear character has often afforded a useful help in the investigation 
of the latter, particularly in the case of integral equations. The object of 
the present investigation (of which the first portion is here presented) is to 
treat a considerable range of transcendental boundary value and expansion 
problems in close connection with certain algebraic problems of which they 
are the limiting cases. 

It is necessary first of all to formulate and solve the algebraic problems 
with special reference to their use as a heuristic guide in discovering truths 
and their proofs for the limiting cases which are matters of prime interest. 
From the outset classic theorems for certain transcendental cases throw a 
light back upon the algebraic questions and are of great value in formulating 
arid in solving the algebraic problems. Thus we have from the outset a 
valuable interaction between the algebraic problems on the one hand and 
the transcendental problems on the other. The great intimacy of this 
interaction becomes increasingly apparent as the investigation proceeds. 

In his researches on integral equations, integro-differential equations, 
functions of lines, and permutable functions, Volterraf has made frequent 

* Presented to the American Mathematical Society, April, 1920. 
f See his "Lecours sur les equations integrates etles equations in te^o-differentielles," 
1913, where an exposition of his work is given with references to his earlier memoirs. 
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70 Carmichael: Boundary Value and Expansion Problems. 

and consistent use of the guide to the transcendental problems afforded by 
looking upon them as limiting cases of algebraic problems. This seems 
to be the first instance of the systematic and profound use of the principle 
of guidance which in a modified or extended form is made to lead the way 
in our study of boundary value and expansion problems. The same 
general principle served Fredholm* as a heuristic guide in his fundamental 
memoir on integral equations; and Hilbertf carried through the limiting 
processes which served Fredholm merely as a guide and deduced his results 
as limiting cases of algebraic propositions when the number of variables 
becomes infinite. 

Though the guide to transcendental problems afforded by the properties 
of algebraic equations has attracted the greatest attention in the field of 
integral equations and the closely related matters, it was not here that the 
method was first employed heuristically. It is indeed the unpublished 
method which Sturm employed in his fundamental researches on differential 
equations of the second order. The differential equation with boundary 
conditions may be looked upon as the limiting case of a corresponding 
difference equation with boundary conditions, the latter being but an 
abbreviated form of a certain restricted system of algebraic equations. 
The passage to the limit from the difference equation to the differential 
equation may be carried through rigorously in the case of several boundary 
value problems, as was shown by Porter in 1902 (more than two years before 
Hilbert took a similar step for integral equations). J 

An examination of the previous study of differential equations from the 
point of view in consideration brings out the fact that a given differential 
equation with boundary conditions may be realized in an infinite number 
of ways as a limiting form of algebraic systems. The investigator must 
therefore exercise care in choosing that algebraic system of which a maximum 
number of properties persist if he is to obtain the greatest advantage 
from the interaction of the two problems. The results in § 6 of the present 
paper were suggested by classic theorems for differential equations; success 
in arriving at them required first the choice of a particular form of algebraic 
system to yield the differential equation and the generalization of this form 
so as to maintain the requisite characteristics. The scaffolding by which 
the results were discovered has not been reproduced in the section. 

Similarly, one may look upon partial differential equations, integro- 

* Acta Mathematica, 27 (1903): 365. 

t Gottingen Nachrichten, 1904, p. 49. 

J For references and a fuller discussion of matters referred to in this paragraph the 
reader may consult B6cher's lecture before the Fifth International Congress of Mathe- 
maticians and his "Les m&hodes de Sturm." 
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differential equations, and various types of mixed equations, each as a 
limiting form of appropriate algebraic systems. Moreover, one may con- 
sider sets of algebraic systems and their limiting forms of such sort as to 
furnish guidance in the study of systems consisting of differential equations, 
difference equations, integral equations, and so forth, and any one of many 
combinations of these. The algebraic theory developed in the present 
paper is of such sort as to furnish guidance in the investigation of boundary 
value and expansion problems associated with each of these various types 
of equations and systems, as I shall make clear in later papers recording 
the results of the present general investigation. 

The matter developed in this paper may be outlined as follows: In § 2 
are recorded preliminary considerations relative to sets of adjoint algebraic 
systems involving a finite number of parameters subject to determination 
so as to render the systems consistent. The conjugate character of the 
solutions of these systems is treated in § 3 and properties are established 
similar to those of orthogonality and biorthogonality in the theory of func- 
tions. These results are applied in § 4 in deriving the 'expansions' of 
sets of constants in terms of conjugate sets. A certain graphic representa- 
tion of solutions is defined and analyzed in § 5 and is employed in § 6 in 
deriving and extending certain theorems analogous to the Sturmian zero 
separation theorems for linear differential equations of the second order. 
In § 7 there is a discussion of the general character of a fundamental 
limiting operation (which is to be employed frequently in analyzing the 
transcendental problems which are the goal of the investigation); and in 
§ 8 a second type of limiting case is briefly treated. Variation of parameters 
and Green's functions for algebraic systems are the topics discussed in § 9. 
Finally, in § 10, a method is given for the condensation of the algebraic 
expansions of § 4 into contour integrals, the methods and the results being 
analogous to those which Birkhoff (see reference in § 10) has developed for 
a certain class of differential systems. 

2. Adjoint Algebraic Systems. — Among the natural ways of introducing 
the so-called adjoint algebraic system in connection with a given algebraic 
system is one which is intimately related to the usual method of introducing 
the adjoint differential expression in connection with a given differential 
expression. We recall that the differential expression M (v) which is adjoint 
to a given homogeneous linear differential expression L(u) is gotten by 
seeking a « such that an indefinite integral of vL(u) can be written as a 
homogeneous linear differential expression in u of order one lower than 
that of L(u). Following up the analogy and employing a sum as to i in 
place of the integral used in the case of differential expressions, we are led to 
seek the conditions on y\, y%, • • • , y n such that for given an the coefficients 
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(iij exist of such sort that we have 

n n n 

' i Vi 2—i a a%} = 2—i PkjXj 

i—l j=l j=l 

J** 

for each k of the set 1, 2, ■ ■ ■ , n. We see that we must have 

n 
1=1 

for every k. Thus with the first of the two sets of linear forms 

n n 

2—1 Ot-ifltji 2—1 a ]iyj> * = 1) "> ' ' ' > n > 

i=l ;=1 

we are led to associate the second. If we start with the latter it is clear 
that we shall be led in the same way to the former. The two systems of 
forms are said to be adjoint each to the other. 

As an analogue of the classic Lagrange identity [involving vL(u) 
— uM{v)~\ in the theory of adjoint differential expressions, we have the 
readily verified identity 

n ( n w "I 

X) | Vi2~2 onjXj — Xi X) anyj \ = 0, 
*=i { j=i j=i J 

which will be found to serve us in a fundamental way as a guide to the 
method of approach to numerous problems. 

Let us now consider the r homogeneous linear algebraic systems in the 
unknown quantities x, 

(1) 2j ( a 0hij + ^lCtlhij + ~^2<hhij + * * ' + \(hhi})%H} = 0, i = 1,2, ■ ■ ■ , n%, 

a separate system being formed for each value h of the set 1, 2, • • •, r. 
Here Xi, X2, • • • , X r are r parameters by the choice of which the simultaneous 
consistency of the r systems is to be secured. With these systems let us 
associate the adjoint systems 

(2) 2 (a ohji + \ia lh ji + \2a2hji + • • • + \rOrhji)yhj =0, i = 1, 2, • • • , n h . 
j=i 

A necessary and sufficient condition that each of the r systems in (1) 
shall have solutions not identically zero is that each of the equations 

(3) |aoA»y + Xianiy + • • • + X r a rA #| =0, h = 1,2, • • •, r, 

shall be satisfied, where for a given value of h the first number is a deter- 
minant of order nh whose element in ith row and jth column is that which 
is written out explicitly. Obviously we have the same necessary and 
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sufficient condition that each of the r systems in (2) shall have solutions 
not identically zero. 

A set of (finite) values of Xi, X 2 , • • • , X r for which (1) [(2)] has for each 
h a solution not identically zero will be called a set of characteristic values 
for (1) [(2)]. We have just seen that (1) and (2) have the same sets of 
characteristic values, since the sets of characteristic values are the (finite) 
solutions of system (3) considered as a system of equations for determining 
Xi, X2, • • • , X r . 

We shall suppose that the coefficients a are of such sort that each of the 
expanded determinants in (3) has explicitly present at least one of the 
parameters X. Then system (3) is a set of algebraic equations r in number 
and involving r unknown quantities. We assume furthermore that the 
coefficients a are such that these r relations are independent in such wise 
that we have only a finite number of sets of characteristic values. 

These sets of characteristic values we shall then denote by 

XftXSft •••,X ( / ) 

for varying values of p, the two ordered sets being distinct for two distinct 
values of p. The corresponding solutions of (1) and (2) we shall then denote 
by 

(4) a#, $1 j=l,2,---,n h ,h=l,2,---,r. 

3. Conjugate Character of the Solutions of (1) and (2). With the notation 
adopted in the preceding section for solutions of (1) and (2) we have relations 
which may be written in the form 

"a 

(5) X (a oh ij + ySf^ihij + • • • + WarhijWi?) = 0, i = 1, 2, ■ ■ ■ , n h , 
i=i 

(6) £ (Oo«i + Xfo^-i + • • • + WOrkjiWtf 
3=1 

»* r 

+ 11 (X ( .»> - X?)a shji y% = 0, t = 1, 2, • • • , n h , 

j=l s=l 

systems being formed for each value h of the set 1, 2, • • •, r. For fixed h 
and i let us multiply the former of these equations member by member 
by yff and the latter by — x$, and let us then add the two resulting equa- 
tions member by member. Still holding h fixed in the relation so obtained, 
sum as to i from 1 to n\. That part of the first member of the resulting 
equation which comes from the first member of (5) and the first line of the 
first member of (6) balances to zero and we have a relation which may 
readily be reduced to the form 

r n h n h 

(7) X (x<r> - x?) E E <*.«**&# = 0, h = 1, 2, • • • , r. 

8 = 1 1=1 J = l 
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Here we have r equations involving the r quantities X ( s ff) — X w , s = 1,2, 
•■■, r, these being not simultaneously zero when p and a are different. 
Hence the determinant of the coefficients of these quantities in (7) must 
have the value zero. If we employ different summation variables i and j 
for the different rows in this determinant, the relation may be put in the 
form 



EI 



2-, 2-, a w h i h x& h yi?j h 



o, 



P + <r, 



where the element written explicitly is that in the 5th column and the Mi 
row. It is easy to see that this relation may be put into the following more 
convenient form: 



(8) 



E E 



£ £ • • • E E D ilh .,. t ^tlx^j/fji = o, 



P + <*, 



where D^...^ denotes the determinant 

a Wiii ct 2iy 1 i, • • • flriy,;, 



«i2y. 



&22.J, 



a r2y 2 



air 



02; 



rj P » r 



This relation for varying p and o", expresses the fundamental conjugate 
character of the solutions of (1) and (2) with respect to each other. 

In (3) let the Xi, • • • , X r be replaced by the set of characteristic values 
X ( i p) , • ■ •, X ( r p) . For a given h let o$j denote the cof actor of the element in 
the iih row and jth column of the determinant in the resulting first member. 
Then, if for each h some one of these cofactors is different from zero, we 
have a relation of the form 



if?) 



M 



•*7tl • u 'h2 

Similarly, we have 

ytt ■ if& 



rto = /vto 



: a 



.to 



: a' 



■to 



I/to = -yto . ™to 

ilhn h "*y • lx h2j 



ci 



,fp) 



Employing ^ and »?^ as the (necessarily non-zero) factors of proportionality, 
we have 



Vhk ~~ Vh^hhj- 



■rto = t /vto 

If we denote the first member of (8) by S(p, a) we have then 
S( P , p) 



(9) 



n« 



a^a 



ftl «i n r n r r 

. = y y . . . y y n, . . 4 t\ a w a (p) 

«,=1 ^=1 i p =l JV=1 A=l * * 
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Now the second member of (4) depends only on the coefficients in equa- 
tions (1) and (2). If i and j exist so that this second member is different 
from zero we have S(p, p) =1= 0. 

Since we shall be interested in these algebraic results primarily for their 
use as a heuristic guide in certain transcendental problems we shall naturally 
exclude from consideration such exceptional cases as are complicated or 
otherwise fail to serve our purpose. Consequently we shall suppose now 
and usually henceforth that the coefficients of (1) and (2) are of such character 
that the second member of (9) is different from zero for every p. Then we have 
the following result: 

The first member of (8) is equal to zero when p =j= <r and is different from 
zero when p = <j. 

In the special case in which (1) is self-adjoint and the x's and the y's, 
for a given p, are taken to be the same, it is clear that the condition that all 
determinants in (8) shall have the same sign (excluding therefore zero values) 
is a sufficient condition for the non-vanishing of the first member of (8) 
when p = <j. 

In order to bring out clearly the nature of the conditions of conjugacy 
which we have just established let us consider the special case in which 
r = 1. Systems (1) and (2) may then be conveniently written in the form 

n n 

(10) ]C (en + ^bij)xj = 0, X (en + \bji)yj = 0, i = 1, 2, • • •, n. 
The conditions of conjugacy reduce to 

pi) tp^iiilii:. 

If we have the more special case in which bu = bi, b^ — if j 4= i, these 
conditions become 

(12) £:&tfGty* ) l = 0if<r + P ' 

When bi = 1 for every i these become merely the usual conditions of bi- 
orthogonality; and these in turn reduce to the usual conditions of orthogon- 
ality in case the two systems in (10) are identical and the same solutions 
x and y are taken for the two systems. From this it is seen that our formulae 
give extensive generalizations of classic elementary relations of wide use- 
fulness. 

Let us consider a special case of equations (1) and (2) giving a rather 
simple generalization of the results in the preceding paragraph. Let us 
suppose that each system in (1) contains but a single parameter, say that \ h 
is the only parameter in the system for a given value of h. Then the r 



76 Caemichael: Boundary Value and Expansion Problems. 

equations (3) involve each a single one of the r parameters Xi, • • • , X r , so 
that the possible values of any given parameter are obtained by solving a 
single equation explicitly given. All. possible combinations of solutions 
are allowable in forming the various sets of characteristic values. The 
determinants in (8) reduce in the present case to their diagonal elements, 
so that we have for this case the simpler conditions of conjugacy 



= if a 4= p, 
* if <r = p. 



(13) SI-'SE II a hhjhih x ( h %y%{ ) 

If for a given subscript Jc no characteristic value of X& is equal to zero 
we may divide systems (1) and (2) by X* and so introduce a new set of r 
parameters 1/X&, X.-/X* for i =j= &• These enter linearly and in the same 
way as the original parameters. It is easy to see that the solutions x and 
y are the same as before. Consequently we have new sets of relations 
similar to (8) and (13) and differing from them only in having a khi j re- 
placed throughout by a oh ij. 

4. Expansions by Use of Conjugate Sets. — Let m be the number of sets 
of characteristic values of Xi, • • • , X r and let us suppose that the constants 
Zf,i,...», for i h varying from 1 to n h for each h may be "expanded" in the form 

m 



ri r > 



where the c* are independent of the subscripts ih- Then the properties of 
conjugacy developed in § 3 are available for an immediate determination 
of the value* f the Ck — much after the manner of determining the coeffi- 
cients of a Fourier expansion. For this purpose we multiply both sides of 
equation (14) by yfy ••• y ( r l ) r times the determinant D^...,-^ explicitly 
written in connection with (8) and in the resulting equation sum as to the 
i and the j. In view of the conditions of conjugacy the resulting quantity 
in the second member depends on only one of the constants Cu, namely cf, 
and we then have 

2—i 2—i ' ' ' 2—i 2—/\ L)ixh ••• v^ijij... % r Wy\j h I 

/I r\ _ '1 = 1 il=l «,=! J,=l \ h=\ J 

ZE-I 2Z(D il3 - 1 ... irJr Ii^^k) 

»1=1 ^1=1 V=l Jr=l \ h=l / 

It is easy to obtain broad sufficient conditions for the validity of the 
"expansion" (14) for any given set z^ ...,; of nin 2 • • • n r constants. We 
suppose that m = nin 2 • • • n r so that the number of distinct solutions of (3) 
is equal to the product of the degrees of the several equations in that system. 
If then we look upon (14) as a system of m equations for determining 
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the quantities c\, c 2 , • • • , c m it is sufficient that the determinant D of this 
system shall be different from zero. But we have seen (in § 3) that 
Xhl = khO^hlt for some appropriate i (dependent perhaps upon h), the 
quantities t-h being different from zero. Hence the determinant D will be 
different from zero if the corresponding determinant formed with af} t in 
place of xf] be different from zero. This last is a condition on the coeffi- 
cients a in equation (1). Thus we may express in terms of the coefficients 
in (1) broad general conditions which are sufficient to ensure the validity 
of the expansion (14), where the coefficients Ci have the values given in (15). 

It is not in accordance with our present plan to seek those modifications 
of the foregoing expansion which are necessary in the exceptional cases 
excluded from the preceding discussion. It does not appear that we shall 
need the theory for these cases in order to avail ourselves of the heuristic 
guide afforded by the algebraic theory in its non-exceptional and more 
general aspects. 

In order to bring out clearly the essential simplicity of these formulae 
let us observe that for the special cases involved in equations (11) and (12) 
we have 

n 

(16) Zi = 12 c k xf\ i= 1, 2, •■•,», 

where c k has one or the other of the values 



(17) Ct --^-^- 



12 12 bjiZiyf 12 biZiy 



x*) 



,(M„,W 



1212bjiX?yT 12biX7'y 

i=l j=l «=1 

according as we have the case of (11) or of (12). If bi = 1 the latter reaches 
the maximum of elegance, at least if equations (10) are then self-adjoint 
and the same solutions x and y of the two systems are taken. 

For the general case when m = nin 2 ■ • ■ n r there is a certain gain in 
suggestiveness if we denote the parameters and solutions of (1) and (2) by 

\(*iA;2 .-•*,•) (ii* 2 ...* r ) «i* 2 ...* r ) 

where k s runs over the set 1, 2, • • • , n s . Then (14) takes the form 



(18) 



n\ n r / r \ 

1* 2 ... i r = 2-1 ' " * 2-1 1 Ck 1 k t ...k r LL X lii\ '" ' ) • 
&!=1 * r =I \ h=l / 



The coefficients c are determined in the same manner as before. Just as we 
may look upon (16) and (17) as the analogue of expansions of functions of 
one variable in orthogonal functions of that variable (including the special 
case of Fourier series) so shall we be able to look upon (18) as the analogue 
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of like expansions (including double Fourier series) by which functions of 
several variables are expressed in terms of products of functions each of one 
variable — such expansions being of the kind used by the phsyicists in the 
solution of many classical problems. Indeed these are much more than 
analogues; transcendental expansion problems of several well-known types 
(including those mentioned) and of many new types are as a matter of fact 
limiting cases of the algebraic expansion problem which we are treating 
(and we are developing the latter primarily for its applications to the former) . 

In the foregoing expansion formulae the number of subscripts on the 
"function" z to be expanded in terms of a given set of constants by aid 
of the property of conjiigacy is equal to the number of parameters X involved 
in the original system of algebraic equations. When we proceed to our 
transcendental limiting cases we shall see that these algebraic results are 
in the form best suited to applications to equations involving functions of 
one variable, as ordinary differential equations, ordinary difference equa- 
tions, integral equations, and certain types of mixed systems. In order to 
obtain a form suitable as the heuristic guide in problems involving partial 
differential equations or equations of any type in which we have functions 
of more than one variable in the original equations, it is desirable to look 
upon our expansion formulae in a way slightly different from that in evidence 
in the foregoing work. 

We can best bring out what is needful by considering first the particular 
expansion of equation (16). Let us suppose that n is the product \xv of two 
integers. Let us replace the subscript i, running over the set 1,2, • • • , n, 
by the double subscript ij where i runs over 1, 2, ■ • ■, n, and j over 1, 2, 
• • •, v. Then equations (16) become 



(19) zy = £ c k xf] , i = 1, 2, • • •, n, j = 1, 2, 



v. 



The coefficients c h are of course determined in the same way as before but 
are naturally expressed in a form differing from that in (17) by having the 
single summation as to i replaced by a double summation as to i and j. 

5. Graphic Representations of Solutions. — Let us consider the graphical 
representation of the set U\, u 2 , • • • ,u n of constants in the following manner. 
On any given straight line segment (as for instance the points s such that 
a = 5 = fe) let us erect n perpendiculars two of which are at the ends of the 
segment while the other n — 2 are evenly or evenly distributed on the 
interior of the interval. Let these be marked from left to right by the 
numbers 1, 2, • • •, n; and consider them as analogous to the n coordinate 
axes of a space of n dimensions. Considering (ui, u 2 , • • • , u n ) as a point in 
space of n dimensions we may now represent this single point by a certain 
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junction of n points in our figure, one on each of the axes, the ith one being 
on the ith axis and at a distance | Ui | from the original segment and above 
it or below it according as m, is positive or negative. Now join by straight 
line segments the point on each interior axis to the points on the two adja- 
cent axes. We thus obtain a broken line. We shall say that this, broken 
line is the graphic representation* of the point (uiu 2 ■ • ■ u n ) in n dimen- 
sions or of the set of constants u\, u 2 , • • • , u n . The points at which (values 
of s for which) this broken line cuts the original line segment (viewed as the 
axis of s) we shall call the zeros of the set Ui, in analogy with the usual ter- 
minology for the zeros of a function u(s). 

Now let us suppose that the same set of axes is used for the representa- 
tion of the n sets xf\ k = 1, 2, • • • , n, and the set Zi of equation (16). 
Let x^is), k = 1, 2, • • • , n, and z(s) denote the functions of the continuous 
variable s represented by the broken lines corresponding as indicated above 
to the foregoing sets of constants. Then we shall show that 

n 

(20) z(s) = E etx<*>(*), 

where the constants Cj, have the same values as in (16). For this purpose 
it is sufficient to consider the graph between two consecutive vertical 
axes, say between the ith and the (i + l)th. Let s, and «; + i be the values 
of s at the intersections of these vertical axes with the s-axis. Then between 
the two vertical axes in consideration we have 

Z (s) = Zi + J^Lh. (z i+1 - zt), *<*>(*) = xf + ^~ Gtfii - ^')> 

Sj-fl — Si °l'+l "i 

k = 1, 2, • • •, n. 

From these relations and from (16) with the subscripts i and i + 1 it follows 
that (20) is valid for the interval in consideration. Hence (20) is valid 
for all values of s on the range a ^ s ^ b of the original line segment. 

Let us consider the like matter for functions of two subscripts and 
expansions of the form (19). For the representation of u { j for i = 1, 2, 
• • • , n, and j = 1,2, • • • , v, we shall start from v planes, one for each value of 
j. In each of these we use for s the same range a si s ?=b and place the 
planes in order 1, 2, • • • ,v for j each directly in front of the preceding one 
and arrange the vertical axes so that the axes in any one plane are the ortho- 
gonal projections on that plane of the axes in any other plane. Then for 
fixed j we extend the Uij to uj (s) by linear interpolation as before. Then 
for each value of s we connect the points Uj(s), j = 1, 2, • • • , v, by straight 

* Essentially the same graphic representation has been employed by M. B. Porter in 
Annals of Mathematics (2), 3 (1901), p. 56. 
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line segments joining the consecutive points. We thus get a sort of broken 
surface affording the graphical representation of a function u(s, t), gotten 
(we may say) by linear interpolation from the points «,-/. We call this the 
graphical representation of the set of constants u { j fori= 1, 2, • • •, n, and 
j = 1, %, • • ■ ,v. Let c S < = d define the range of t in this representation, 
this range evidently depending on the positions of the v planes employed 
in setting up the graphical representation. 

Let us replace the subscripts i, j in the functions in (19) by the con- 
tinuous variables s, t in accordance with the method just indicated. It is 
easy to prove that we then have 

ixv 

(21) z(s,t) = Y,c k x w (s,t), a^s^b, c^t^d, 

k=l 

where the constants c k have the same values as in equation (19). In fact 
the argument associated with (20) shows that we have 

I1.V 

zy(«) = T,c k xf\s), j = 1, 2, ■ ■ ■, v. 

k=l 

A repetition of the same argument for these last equations with s fixed 
leads at once to relation (21). 

Similar extensions may be associated with equation (14) so that we 
readily come through to the relation 

m 

Z(S U S 2 , ■■■, * r ) = Z) C k xf\si)xf\s 2 ) ■ ■ ■ X^Xsr), 
k=l 

where the c k have the same values as in (14) and the functions involved 
depend on continuous variables. Further generalizations may also be 
made in the direction suggested by the last paragraph of § 4. 

6. On the Distribution of Zeros of Solutions. — The graphic representation 
of solutions described in the preceding section we shall find to afford one 
of the most useful ideas in the heuristic guide to transcendental problems 
arising from the algebraic theory which we are now developing. In order 
to have at hand an aspect of its usefulness not brought out directly by the 
applications to expansion problems, let us consider a certain fundamental 
question concerning the relative distribution of zeros of the solutions of 
certain types of algebraic systems. 

Let us first consider a system of n homogeneous linear algebraic equations 

re+2 

(22) E«««j =0, i = 1, 2, • • •, n, 

in the n + 2 unknown quantities x h x 2 , • • • , x n+2 ; and let us suppose that 
the matrix of this system is of rank n. The system has two solutions Xi = Ui 
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and Xi = Vi such that every solution is expressible in the form a;,- = cut + dxn, 
where c and d are constants, while conversely every such a:,- is a solution. 
The sets Ui and Vi are linearly independent. If Xi = Ui and x»- = «* are any 
two linearly independent solutions and if A k i denotes the determinant of 
the matrix obtained from the matrix of coefficients in (22) by striking out 
the fcth and lih columns, it may be shown that A a and the determinant 
u k Vi — UiVk are both zero or neither zero, provided that when Ah = we do not 
have A m i = = A km for every m of the set 1,2, • • • , n — 2, except k and I. 

In order to prove the last statement, let us write equations (22) in the 
form 

re+2 

/ / a^jXj ancXjc an'Xi* 

Then we have 

(23) A kl x m = ± A m ix k ± A km xi, 

the ambiguous signs ± being obviously determinate. 

Let us suppose that A« =(= 0. Then we can not have simultaneously 
u k = 0, ui = 0; for, if so, (23) would imply that «,- = for every i. Like- 
wise we can not have simultaneously v k = 0, vi = 0. Let u k be one of the 
two quantities u k , U\ which is different from zero. Then if we suppose 
that u k Vi — uiv k = we have v k = ru k and Vi = rui for an appropriate 
constant r; whence it would follow through use of (23) that «,- = rui for 
every i, so that the solutions Ui and Vi would be dependent, contrary to 
hypothesis. Therefore, if A« =t='0 we have u k Vi — u\v k =f 0. 

Suppose next that A« = 0. Substituting in (23) the solutions Ui and 
Vi, we have 

± AmlUk ± A km Ui =0, ± AmiVk ± A km Vl = 0. 

Then, if u k vi — u t v k =(= 0, we have A m i = = A km for every m of the set 
1, 2, •••,n+2, except k and I, contrary to hypothesis. Hence, when 
A k i = we have u k vi — uiv k = 0. 

This completes the proof of the statement in consideration. 

The foregoing result may readily be extended to the case of a system of 
rank n of n equations in n + h unknown quantities, where h is any integer 
not less than 2. If a linearly independent set of solutions is uu, ua, • • • , 
u ki we compare the determinant | Ujla | whose element in jth row and ith 
column is Ujki with the determinant A klkr .. kk of the matrix of order n 
remaining when one strikes from the matrix of coefficients of the original 
system the columns with numbers k 1} k 2 , • • • , k h . For a given set hi, k 2 , 
• • • , k h these determinants are both zero or neither zero, under conditions 
similar to those named in the preceding case. 

If we replace x in (23) by u and by v we obtain readily from the resulting 
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equations the relations 

(24) A H 

and, in particular, the relations 



t*m ™l 


= dzAmi 


U k Ui 


V m Vi 




Vk Vl 



»*J fc+1 



Uk+\ Uk+2 
Vk+1 Vk+2 



= A 



k+1; k+2 



Uk Uk+l 
Vk Vk+1 



k=l,2, 



Hence, if A,-, ,+i for a given range of consecutive values of the integer is i 
of one sign (excluding the value zero), then the determinant w,-, 



V){ = 



Ui Ui + i 
«» Vf+i 



is of one sign for every i of the same range. It is obvious that this result 
also may be appropriately extended to the more general case mentioned in 
the preceding paragraph. 

Let us now prove the following theorem : 

Suppose that A,-, i+1 for a given range R of consecutive values of the 
integer i is of one sign (and hence not zero). Let k and I be two integers of 
this range, and suppose that u k and u k +i are not of the same sign and that 
if either of them is zero it is u k (in which case Uk+i is certainly different from 
zero). Suppose again that ui and wr+i are not of the same sign, and that 
I is the smallest value of the subscript greater than k for which this is so. 
Then an integer h exists, k ^ h t= I, such that vk and Vh+\ are not of the 
same sign. Moreover, there are not two such values of h except possibly 
for the pair h = k, h = I. 

The last statement follows readily from the preceding part of the 
paragraph; for, if it were not true, the earlier part of the theorem could 
be applied with u and v interchanged so as to show that the consecutive 
character of u k and ui is not maintained. 

For the given range R of values of i the determinant Wi is of one sign, 
as we have already seen. Without loss of generality we may suppose that 
Wi > 0, since if. it were less than zero we should merely have to change the 
sign of every u t or of every «,-. Then we have 

UiVi + i > Ui+iVi. 

Let us first consider the case in which Uk = 0. Then Vk is of the opposite 
sign to Uk+i. Without loss of generality in argument we may (and we will) 
take Uk+i positive and Vk negative. Then u k +\, ■ ■ ■ , ui are all positive while 
ui+i is zero or negative. If m is zero or negative we see from the inequality 
uivi + i > ui + iVi that vi+i is positive. Hence either vi or vi+i is positive. 
Hence there is a change of sign in the sequence v k , Vk+i, • • • , »h-i so that the 
statement in consideration is true for the case when u k = 0. 
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If Uk 4= we may take it to be negative. Then Uk+i, • • • ,ui are positive 
and ui+i is zero or negative. From the inequality UkVk+i > Uk+iVk we see 
that if v k is positive then Vk+i is negative and the truth of the statement in 
consideration is granted. It remains to consider the case when Vk is nega- 
tive. Either the statement is verified or we have vu+i, ••-,»; all negative. 
In the latter case we see from the relation uivi + i > ui + ivi that the second 
member is zero or positive and hence that vi+i is positive. Hence vi and 
vi+i are of different signs and the statement is verified in this case. 

This completes the proof of the statement in consideration. 

Let us now consider the relative distribution of the zeros of the functions 
u(s) and v(s) gotten from the set of constants u t and rn by linear interpolation 
after the method of § 5. As in the immediately preceding discussion we 
confine attention to a sequence of consecutive intervals corresponding to a 
range R of consecutive values of the subscript i for which A,-, ;+i is of one 
sign. From the results just proved in the foregoing paragraphs it follows 
that there is a zero of v(s) between two consecutive zeros of u(s) except 
possibly for the case when the h of these paragraphs has the value Jc or I. 

Let us consider the case when h = k. We have 

while Vh+i and «* are not of the same sign and are not both zero. If u k = 
we have a case when v(s) has a zero between the two given consecutive 
zeros of u(s). Then consider the case when Uk 4= 0. Then u k and u k+1 
are of different signs; and we may take the former to be negative and the 
latter positive without loss of generality in argument, and this we do. If 
in the interval joining the points corresponding to k and k + 1 the zero of 
v(s) is to the right of that of u(s) we have a zero of v(s) between the two 
consecutive zeros of u(s). We then consider further the other case, namely, 
that in which the zero of v(s) in the interval in question is to the left of 
that of u(s). In this case Vk+i 4= 0. If v k +i is positive we have 

U k Vk 



M/b+1 Vk+1 

which is contrary to the present hypothesis that the zero of v(s) in the inter- 
val in question is to the left of that of u(s). Hence we must now have 
Vk+\ negative. Then either v(s) vanishes between the two consecutive 
zeros of u(s) or vi is negative. We consider the latter possibility. Now u% 
is positive. Hence from the relation uivi+i > ui+ivi we have 

Vl+l Ul+l 
Vl Ul 
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From this and the fact that u t and Mz+i are not of the same sign it follows 
readily that the zero of v(s) in the interval from I to I + 1 is to the left of 
that of u(s) in the interval, and hence in this case that a zero of v(s) occurs 
between two consecutive zeros of u(s). We have now exhausted all the 
possibilities for the case when h = k and have found that in this case a 
zero of v(s) certainly occurs between two consecutive zeros of u(s). 

The case when h = I may be treated in a similar way, with the same 
conclusion. 

From this it follows that there is always at least one zero of v(s) between 
two consecutive zeros of u(s) on the interval in consideration. There can 
not be more than one; for, if so, the result could be applied with u and v 
interchanged so as to lead to the conclusion that u(s) should have a zero 
between two consecutive zeros of the same function. 

The result thus obtained may be formulated into the following theorem : 

Theorem. Let A,-, ;+i for a given range R of consecutive values of the 
integer i be of one sign and let I denote the interval of the s-axis corresponding 
to this range of i in the sense of the treatment in § 5. Let u t and Vi be two linearly 
independent solutions of system (22) ; and let these solutions be extended by the 
method of linear interpolation employed in § 5 to the functions u(s) and v(s) . 
Then on the interval I the zeros of u(s) and v(s) separate each other. 

Let us now consider more generally a system of equations 



(25) 



n + h 

2—1 MijKj = "j 



i = 1, 2, 



•, n, 



in the n+h unknown quantities xi, x 2 , • • •, x n+ h, where h ^ 2; and let 
us suppose that the matrix of this system is of rank n. The system then 
has h linearly independent solutions; we designate such a set by 



~(i) ~(?) 






Let Di be the determinant of order n of the square matrix gotten from 
the matrix of coefficients in (25) by striking out h consecutive columns 
beginning with the ith; let J? be a range of consecutive values of the subscript 
i for which Di is of one sign (zero values being excluded) ; and let I denote 
the interval of the s-axis corresponding to this range of i in the sense of 
the treatment in § 5. 

Now let Wi denote the determinant 



(26) 
where A, A 2 



Wi = 



U'l «v z _|_l ii/t + A— 1 

t(2) t( 2 ' . . . <r(. 2 > . , 
tC*) t^) , • • • r ( ^ * , 


= 


x ( P AxP ■ ■ ■ A"- 1 *?' 
xf Ax? ■ ■ ■ A h -^P 

xf Axf • • ■ A h ~ x xf 



• , A A_1 , in the last form of the determinant, denote the first, 
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second, • • •, (h — l)th differences of the X{ with respect to the variable i. 
It is obvious that the two forms of the determinant have the same value. 

Since D» is of one sign for i on R it follows from the earlier work in this 
section that Wi is of one sign for i on R. Let us consider the matrix of any 
m rows of the first [second] determinant form for w { in (26) and let 
Ai m j[_Ci m j2, j = 1, 2, • • •, j m , be all the m-rowed determinants formed from 
this matrix. Let B im j[D im j^], j = 1, 2, •'• • , j m , be the corresponding alge- 
braic complements. By means of the Laplace development for determi- 
nants we then have 



3vn, Jm 



3=1 j=l 

Suppose that k is a value of i on the range R such that J5» m y QD» m /I] is 
of one sign or zero for each j of the set j = 1, 2, • • •, j m ; and suppose that 
I is a value of i also on R for which these quantites are of the opposite sign 
or zero. Then, since w* is of one sign for i on R, it can not be true that all 
of the quantities A km j, Ai„j \_Chmj, CW] are of one sign for the fixed value 
of m and for j varying over its whole range or indeed over just that part 
of its range for which the corresponding Bkmj or Bi mj - \_Dkmj or Di m j\ has a 
value different from zero. 

In particular, if Bkmj and Bi mj - \_Dhmj and Di m j~] both have the value 
zero except for a single value p of j and for this value have different signs, 
then Akmp and Ai mp \_Cu mp and C; mp ] have opposite signs. Hence the 
function Asm p [Osm^ obtained from Ai m? \_Ci m ^\ by linear interpolation as in 
§ 5 has a zero on that part of the s-axis which corresponds to the range of i 
from Jc to I inclusive. 

Let us now consider the first determinant in (26) for the case when m is 
unity and the one row singled out is the last one. Then the Am, for 
varying j, are the elements of the last row of the determinant and the Buj 
are their cofactors. If for i = k these cofactors are of one sign or zero and 
for i = I are of the opposite sign or zero, where k and I are both on the 
range R of i, then not all of the quantities xf\ x^+x, • • • , £ ( /+a_i are of one 
sign. Hence if we form the function x (K> {s) by linear interpolation from 
x^ this function a; (W (s) has at least one zero in the interval corresponding 
to the range of i from k to I + h — 1. Thus for the cases when our results 
apply we are able by means of h — 1 linearly independent solutions of (25) 
to define an interval for i and a corresponding interval on the s-axis such 
that every solution x ( P of (25) which is linearly independent of the first 
h — 1 solutions gives rise by linear interpolation to a function cs (w (») which 
vanishes on the interval of the s-axis in question. It will be observed that 
this result is a direct generalization of a portion of that obtained above for 
the case when h = 2. 
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Let us consider the second determinant in (26) for the case when m 
is unity and the one row singled out is the last one. Then the Cm, for 
varying j, are the elements of the last row and the Dn 3 - are their cofactors. 
If the latter f or i = k are of one sign or zero and for i = I are of the opposite 
sign or zero, where k and I are values of i on the range R, then the quantities 
xV, kxf\ ••-, k^xf, for the two values k and I of i, can not all be of the 
same sign. In particular, if they are all positive for i = k, then one at least 
of them must fail to be positive at i = I; so that at least one of them changes 
sign or becomes zero in the interval in question. 

We may look upon the modification of the first determinant in (26) to 
produce the second as a single instance of a great variety of transformations 
of that first determinant, each being made by replacing columns in that 
determinant by various linear homogeneous combinations of columns (the 
coefficients being constants or functions of i) in such wise that the non- 
vanishing of W{ on a range R implies the non- vanishing of the modified deter- 
minant Wi on the same range R. For every such to,- we may obtain a se- 
quence of theorems of the sort just brought to light in the treatment of the 
two forms given in (26). Such properties as are thus indicated will be 
useful to us later in the study of certain transcendental problems which are 
limiting cases of the algebraic problems now in consideration. 

Solutions of (25), for a given value of h > 2, may also be studied by 
means of similar systems for a smaller value of h, this smaller value of h 
being not less than 2. For this purpose we adjoin to (25) one or more 
additional equations in the same unknown quantities, these equations being 
linearly independent of each other and of those in (25) . In particular, the 
system may thus be replaced by a new system of the same form but with 
only two linearly independent solutions. The foregoing results for such a 
system, when applied to this, yield properties of those solutions of (25) 
which satisfy the auxiliary conditions, the latter being somewhat analogous 
to boundary conditions for differential equations. A considerable hold 
can thus be gotten on a class of solutions of (25) . This obvious remark will 
serve a useful heuristic purpose in studying certain properties of differential 
equations with boundary conditions. 

In this section we have confined ourselves principally to that part of the 
range of i for which D t is of one sign. We propose the problem of investigat- 
ing the matter for the whole range of i from 1 to re and thus of associating the 
zeros of Z>, and of certain combinations of the solutions of (25) for the whole 
range of i from 1 to n. 

7. General Character of a Fundamental Limiting Operation. — It is well 
known, as we have already pointed out more fully, that several important 
types of functional equations, such as linear differential equations, linear 



Caemichael: Boundary Value and Expansion Problems. 87 

integral equations, etc., can be exhibited as limiting cases of algebraic 
systems. In a large range of limiting cases the conjugate character of the 
solutions of (1) and (2) which we have discussed in § 3 and the expansion by 
use of conjugate sets treated in § 4 are carried over to the limiting problems 
in such a way as to afford a definite suggestion of properties to be expected 
and of methods of analysis for examining them. We shall now consider 
the general character of the limiting operation in question with reference 
to the properties just indicated. 

The graphic representations employed in § 5 afford a starting-point. 
Let us take a fixed interval a Si s =§ b of the real s-axis and let us associate 
with certain points of this interval the discrete values of i and j in equations 
(1) and (2). For the hth equation in either system we take on (ab) a set of 
points rift in number including the points a and b; and we interpolate x%j 
into a function Xh(s) by linear interpolation as in § 5. Similarly, a function 
dkhij is interpolated into a function akh(s, t) by a method also described in § 5. 
Equations (1) and (2) may now be looked upon as establishing relations 
among the functional values, of these functions of s and t at certain points 
only of the axes of s and t; and so of defining the solution functions at these 
points and these alone, their definitions being completed by the method of 
interpolation agreed upon. 

The limiting processes described consist essentially in this : let the various 
numbers n^ (or at least a part of them) increase indefinitely; and as they 
increase let the functions Xh(s) pass through a corresponding sequence of 
changes. Various limiting processes are thus set up in the original equations 
and in their solutions. If these lead to replacing the original equations by 
well-defined equations and their solutions by well-defined functions, we 
have in the process a suggestion of a heuristic guide to probable solutions 
of the limiting problems and to certain probable fundamental properties 
of these. As we proceed it will be seen that this guide has great usefulness 
in a considerable range of problems. 

We shall usually require that the distribution of basic points on the 
interval (ab) of the s-axis shall undergo change in such wise that the maxi- 
mum distance between two consecutive points shall approach zero as n h 
becomes infinite. This suggests that the sum as to j in (1) and (2) may 
sometimes be replaced by an integral as to t from a to b; and, when this is 
to be done, it is desirable that the coefficients a k hij shall be replaced each by 
a product one factor of which is to correspond to the differential in the 
limiting case. [If the basis points on the s-axis (or £-axis) are equally 
spaced one may introduce this needed factor simply by multiplying the 
equation through by As (or At), the distance between two consecutive basic 
points. This is perhaps the easiest way to make the modification in ques- 
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tion.] In fact such a form has frequently been employed in setting up a 
limiting process to guide one to the theory of integral equations, first by 
Volterra and later by others. In numerous ways (of which that just men- 
tioned is one of the most important) one may subject the coefficients in 
(1) and (2) to subsidiary conditions such that the limiting process in con- 
sideration shall lead to desired forms of functional equations as limiting 
cases, whether differential equations or integral equations or equations of 
other type. 

The several systems in a single set of systems (1) or (2) are independent 
of each other in such wise that the limiting processes may be applied to 
each with a certain measure of independence of the others, so that we might 
have for instance an ordinary differential equation and an integral equation 
to make up the limiting system of two equations for the case of two param- 
eters X. Numerous other combinations are logically possible; and several 
of them are interesting for the results to which they give rise. In a second 
paper we shall give a precise characterization of several problems to which 
we are led in carrying out the limiting operation in a variety of ways or 
combinations of ways. 

It remains here to note certain characteristic results for the finite case 
which persist (in modified form of course) in a great variety of limiting cases. 

The property of conjugacy expressed by the equations of system (8) is 
an important one which persists after certain of the limiting processes just 
indicated have been carried out. It takes a large number of forms owing 
to the great variety of ways in which the limiting process may be set up. 
One of the simplest and at the same time most useful of these is that in 
which the determinant D idlmtrJr in (8) becomes a function D(si, t\, •••, 
s r , t r ) and the summation in (8) is replaced by an integration, the algebraic 
system having first been taken in a form which is convenient for passing 
to the limit in a manner to realize such a result. The property of conjugacy 
may then be expressed by the relations 

nb /*b r 

■■■ D( Sl , h, ...,*„ t r ) ■ Il^Wftl'Wr • -dsrdtr= 0, 
*Ja h=l 

P + <r- 
For a wide range of cases we have in the limiting problem an infinite 

number of sets of characteristic values for the parameters X and hence an 

infinite number of sets of functions x ( f(s), y^\t), h = 1, • • •, r, for varying 

p, for which relation (28) is valid. 

One of the most frequently occurring and important special cases of 

(28) is that which corresponds to equation (12), namely, 






b 

b(s)x il '\s)y ( -' r \s)ds = 0, p 4= <r. 
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When we proceed in the second paper to certain important instances 
of the theory here sketched roughly in a general sort of way we shall find 
that equations essentially like (28) or special cases of it appear in a great 
variety of forms; but a little examination of each system will show that 
its equations arise in a natural way as limiting cases of the equations in 
(8) and that one is led to them by the guide afforded by the general con- 
siderations barely outlined here. 

Now if the repeated integral in the first member of (28) has a value 
different from zero when p = <r (a condition which is realized in a wide 
range of important cases, as we shall see) and if a function f(s\, s 2 , ■ ■ ■ , s r ) 
has an expansion of the form 

00 

where the c p are constants and the values of p correspond to the various 
sets of characteristic values of the parameters X, then the coefficients c p 
are readily found by a method analogous to that by which the Fourier 
coefficients for a function are found; and we have in fact 

■ ■ • I f(»U »*, ■ ■ •, Sr)D( Sl , *!,••■, Sr, tr)yWl)yf{U) 

• • • y^iQds-tdh - • • ds T dU 
I ■ • • D(s h h, ■■■, s r , t r ) ■ Jlx ( £\s h )y ( i\t h ) -dsidh ■ • • ds r dt r 

In each instance of our theory this formal expansion or the requisite modi- 
fication of it is used to set the basic expansion problem associated with the 
instance in consideration. 

In the foregoing discussion the number of variables in the function / to 
be expanded is equal to the number of parameters in the algebraic problem 
from which we passed to the transcendental problem. This correspondence 
is not essential to the nature of the process involved. The desired extension 
can best be brought out by starting from the particular expansion (19). 
We may carry out our method of linear interpolation as at the close of § 5 
and obtain the expansion (21). If now we proceed to the limiting case in 
such wise that p. and v simultaneously approach infinity and if we require 
that the distribution of axis points on the s-axis and the i-axis shall have the 
usual property of condensation and if the number of distinct characteristic 
values approaches infinity during the process, we shall be led heuristically 
to an expansion of the form 

/(*, = E c*s<»(*, t), 
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where the x's are now solutions of the limiting problem. It is easy to see 
that the properties of conjugacy are maintained (under appropriate circum- 
stances) and that formulae are therefore easily found for the values of the c k . 
We do not attempt to investigate in general the range of validity of these 
results. We shall later find in them a useful heuristic guide to problems in 
partial differential equations; and for the cases involved in such applica- 
tions we shall analyze the matter of range of validity. 

In a similar way we may obtain numerous modifications of the foregoing 
expansion of/(*i, s 2 , ■ ■ ■ , Sh) by starting from the modifications of equations 
(14) suggested by the method of the preceding paragraph for the simplest 
special case and proceeding in a similar manner. 

Another method of proceeding from (19) to a limiting case will be very 
useful to us in dealing with a system of ordinary linear differential equations. 
In this method we suppose that the passage to the limit is effected in such 
way that n remains fixed so that i is always a discrete variable ranging 
over the finite set 1, 2, ■ ■ • , p., while v becomes infinite and the variable j 
passes in our usual way to the continuous variable s in the limiting equation. 
Then expansion (19) passes over into the form 



/••(*) = E cvtfKs), i = 1, 2, 



k=i 



M, 



a form which may be looked upon as affording the simultaneous expansion 
of fj. given functions /»•(«) of a continuous variable s in terms of p sets of 
functions Xi(s), the coefficients c k being the same in each of the two expan- 
sions.* Obviously, numerous more general forms of like expansions of 
systems of functions of one or more variables may be obtained by passing 
from the general relation (14) to limiting cases in the various ways suffi- 
ciently suggested in the foregoing instances. 

The details of the matters suggested in the three preceding paragraphs 
will be developed only in connection with the instances of certain tran- 
scendental problems to which they afford the requisite guide. 

It is doubtless true that many other properties of the algebraic systems 
can be carried over to certain of the important limiting cases. In fact 
certain of the zero separation theorems of § 6 can be utilized to suggest like 
theorems for the solutions of certain transcendental problems. Moreover, 
the interaction of the two types of problems may well be made to work 
in both directions. A part of the results in § 6 were indeed suggested by 
classic properties of the solutions of linear differential equations of the 

* A special case of expansions of this sort first came to my attention in the dissertation 
of Dr. C. C. Camp (a manuscript copy of which he was kind enough to lend me); and the 
suggestion afforded by it has been very useful to me in the present investigation. 
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second order. Once in hand for the simpler cases these results were easily 
extended to other cases of algebraic systems and then afforded a new guide 
to certain related transcendental problems. There is thus a repeated 
mutual reaction between the two types of problems which is useful in the 
development of the theory of each. 

8. A Second Type of Limiting Case. — Let us now consider the r homo- 
geneous linear systems in the infinite number of unknown quantities x, 

00 

(29) Yl ( a ohij + XittiAy + • • • + \a rhij )x h j = 0, i = 1, 2, 3, • • •, 

a separate system being formed for each value h of the set 1, 2, • • ■ , r. 
With these systems let us associate the r adjoint systems 

8 

(30) X) ( a okji + AiaiA/i + • • • + \a rh ji)y hj = 0, i = 1, 2, • • • . 

Here Xi, X 2 , • • • , X r are r parameters by the choice of which the simul- 
taneous consistency of the r systems in either set is to be secured. For these 
infinite systems a great variety of possibilities may be realized by special 
methods of defining the coefficients a; and a comprehensive analysis of all 
mutual possibilities would require the examination of a great many cases. 
Consequently we shall confine our attention to a range of cases in which the 
theory may be set forth in the simplest manner. 

A set of values of Xi, • • •, X r for which (29) [(30)] has a solution not 
identically zero will be called a set of characteristic values for (29) [(30)3- 
In the case of the finite problem of § 2 we saw that the sets of characteristic 
values for the two adjoint problems were identical. For the infinite case 
of this section we shall consider only those systems for which this property 
is maintained. It is clearly maintained in cases in which those character- 
istic values can be determined by determinantal equations analogous to 
equations (3) of § 2. If this method of determining the sets of characteristic 
values is not suitable we may proceed as follows for a certain range of cases 
of equations (29) and (30) ; omit from each system r equations, one for each 
value of h; solve the remaining equations as non-homogeneous equations, 
after having assigned a value to one of the unknown quantities (an operation 
which can be carried out by known processes in a wide range of cases), and 
suppose that this solution is unique (as indeed it is in a wide range of known 
cases); now substitute into the equation omitted from each system the 
values of the unknown quantities so obtained; thus we have for system (29), 
and also for system (30), r equations involving the r parameters; their 
solutions give the sets of characteristic values. 

Now, we shall suppose that the sets of characteristic values, however 
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determined (whether by one of the methods indicated or by another), is 
denumerably infinite and we shall denote them and the corresponding 
solutions by 

X2°, xfl y$, p= 1,2,3, ■•-. 

Several of the properties developed for the corresponding algebraic problem 
are now readily carried over to these solutions of a limiting problem, at 
least in a formal way. Since our present interest in the general procedure 
arises from intended applications of it to relatively simple instances we 
shall not undertake an analysis of the range of validity of our results, but 
shall content ourselves with little more than an exhibition of the formal 
processes. 

If we proceed by a method in all respects similar to that employed in 
§ 3 and if we have before us a case in which the order of infinite summations 
may be interchanged in ways now needful in carrying out the same method, 
we come through to certain equations analogous to (8) and expressing the 
fundamental conjugate character of the solutions of (29) and (30), namely, 
the equations 

(31) £ E • • • £ B D hh ... irjr f[ afckfci =0, p**, 

•1=1 /l=l V=l Jr=l *=1 

where D,,^...^ is notationally the same determinant as that which is 
represented by this symbol in equation (8). 

Following still the method of § 3 it would be possible to name conditions 
on the coefficients a which are sufficient to insure that the first member of 
(31) shall have a value different from zero when p = <x. Since we have no 
need for the explicit form of these conditions we shall not take the space 
to derive them; we shall merely assume that we have before us a case in 
which the first member of (31) f or p = <r is always different from zero. 

It is obvious that we have particularly simple forms of the conjugacy 
conditions (31) for cases corresponding to those involved in equations (11), 
(12), (13); and that we may have modifications of all of the conjugacy 
conditions analogous to those indicated briefly for the finite case in the 
paragraph following equation (13). 

We are now led to consider the problem of the expansion of a function 
Bijia ... », of r discrete arguments, each on the range 1, 2, 3, • • • , in terms of the 
solutions of one set of systems, the expansion being of the form 

00 

\oZ) S^jg... i r = / , ChXiiflvt, • * • X r i r , 

k=l 

where the coefficients Cu are independent of the variables i\, • ■ • , i r . If the 
function z has an expansion of this form and if certain changes of order of 
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summation involved in the obvious process of reckoning are legitimate, we 
obtain readily for the coefficients c k the values 

oo oo oo oo r 

2—1 2—1 '■' 2—1 2—1 "»lJl •" irir^hh •" »V i-i- V h Jh 

(OdJ Cjfc — oo oo oo oo r > K — L, 4, O, • • • . 

2-i 2-i • • • 2-i 2-r Di 1 j 1 ...i r j r i\_x) l i h y h j t 

The discussion associated with equations (17) and (18) affords sugges- 
tions for the formation of special cases or for modifying the form of expansion 
in (32) and (33). 

Even in this transcendental case one may usefully employ a graphic 
representation of the sort described in § 5. One probably takes most natur- 
ally for an s-axis the real axis from 1 to infinity and erects perpendiculars 
at the points 1, 2, 3, • • • on this axis, these perpendiculars to serve as the 
axes of coordinates. One may then fill in the function by linear interpola- 
tion as in § 5 and so make a function of a continuous variable. One might 
conceivably carry out now a limiting process by which the number of 
perpendiculars in any finite stretch increases indefinitely and the greatest 
distance between two which are consecutive decreases to zero. One has a 
limiting cas"e which may be employed to afford suggestions for dealing with 
differential equations of infinite order. Various modifications and exten- 
sions of this graphic representation are suggested by the foregoing treatment 
for the finite case, particularly that in § 7 ; but we shall not now pursue the 
matter further. 

Besides the generalization of the problem associated with (1) and (2) 
to that associated with (29) and (30) one might treat also that in which the 
number of parameters X becomes infinite while the number of x's and hence 
of y's remains finite or that in which the number of X's and the number of 
x's and y's simultaneously become infinite; but it appears unlikely that 
such generalizations will be as useful as that which is indicated in the fore- 
going paragraphs. 

A rather important problem, upon the resolution of which we shall not 
enter, may be suggested here, namely, the problem of the relative distribu- 
tion of the zeros of linearly interpolated solutions of infinite systems. 

9. Variation of Parameters and Green's Functions for Algebraic Systems. 
■ — Let us consider a system of n non-homogeneous linear algebraic equations 

n+h 

(34) 2~2aijUj =bi, i = 1, 2, • • •, n, 
and the corresponding homogeneous system 

n-\-h 

(35) 2~2 a-i&i =0, i = 1, 2, • • •, n, 



94 Carmichael: Boundary Value and Expansion Problems. 

each in n + h unknown quantities, h being a positive integer, and let us 
suppose that the rank of the matrix 1 1 a„ 1 1 is n. 

In what follows next we shall assume that the notation is chosen so 
that the determinant of the square matrix made up of the first n columns 
of 1 1 aij 1 1 has a value different from zero. If the equations in each system 
are taken in a suitable order (and we shall suppose them to be so written 
already) it is obviously possible to combine them into a new equivalent 
system in the same unknown quantities in such way that the new coeffi- 
cients a^ have the value zero when j < i. We shall now suppose further 
that the original, and hence the new, matrix 1 1 an \ | has the property that 
the determinants of order 1, 2, 3, • • •, n in its lower right-hand corner are 
all different from zero in value. Then it is possible to make further com- 
binations of equations in either system so as to replace the system by an 
equivalent system in the same unknown quantities and in such wise that 
when all this is done the systems (34) and (35) take the forms 

h r 

(36) S«», i+rUi+r = fii, zZ«», i+rXi+r =0, % = 1, 2, • • •, 71, 

r=0 r=0 

where a», ; and on, ; +A are different from zero for every i. For the equations 
in this normal form we have a ready method of obtaining the solutions of 
the non-homogeneous system in terms of a fundamental system of solutions 
of the homogeneous system analogous to, and indeed abstractly identical 
with, the classic method of variation of parameters in the theory of differen- 
tial equations, the latter being in fact a limiting case of the former. This 
method for the algebraic systems we shall now develop in a brief treatment. 
Let us denote by 

Xy , Xj , • , Xj , J 1, /,•••, n ~y~ ft, 

a fundamental system of h linearly independent solutions of the homo- 
geneous system in (36), and hence of that in (35). Then we seek a solution 
of the non-homogeneous system in (36), and hence of that in (34), in the 
form 

u i+t = c?'aS}., + tftfl, + ■■■+ cfx% t , 
(37) 

t = 0, 1, •••, h- 1, i = 1, 2, ••'•, n+ 1, 

where the functions c ( /° are to be determined. The equations in the system 

h 

Z[c?|i - cfy?U +t = 0, t = 0, 1, •••, h-2, *= 1,2, ■•-,», 

h=l 

(38) 

t ItfU - tfrtfU = -£-, t = 1, 2, • • -, n, 

k=l <Xi, i+h 
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are now obtained as follows: those in the first line come from (37) by 
comparison of that equation for a given value i + 1 of i with the equation 
gotten from (37) when t is replaced by t -f- 1 ; those in the last line are 
obtained by substituting the value of u from (37) into the non-homogeneous 
system of (36), the value of u i+t for t = 0, 1, • • •, h — 1 being written as in 
(37) while that of Ui + h is taken in the form 

h 

„ , _ mjx) i . . . i r d) (j,) I y* r t&i _ (*)-i(*) 

We look upon equations (38) as furnishing a system for the determination 
of the functions cf\ 

The condition that (38), for every value i of the set 1, 2, • • • ,n and for 
every ft, shall serve for the determination of the quantities in the square 
brackets is that the determinant A;, 



Ai = 



rC 1 ) , r ( . 2) . . . t ( .' i) , 
•^4-1 ^i+l ^14-1 

~(1) -v(2) ..". ™W 



T W T (2) ... (/.) 



shall be different from zero for every i of the set 1,2, • • • , n. But in § 6 
we saw that these inequalities are equivalent to the conditions that the 
determinant of every matrix of order n obtained from | |a#| | by striking 
out h consecutive columns shall be different from zero. These are then 
necessary conditions for it to be true that every system (34) may be solved 
by the given method of variation of parameters in terms of a fundamental 
system of solutions of (35). These conditions, together with those already 
named in connection with the reduction to the normal systems (36), are 
also sufficient conditions for it to be true that every system (34) may be 
solved by the given method, as we shall now show by actually effecting 
the solution under the named hypotheses. 

If we denote by N-^ the cofactor of the element in the ftth column and 
last row of A; we have from (38) the relations 



8- A ( - S) 

OLi, i+h A 



(39) cfU - ef = ^^ ~ , k = 1, 2, • • •, h; i = 1, 2, • • •, n. 



If we assign to c'/ , or to c^,, an arbitrary value c (8;) , the equations (39) 
serve by recursion to determine uniquely the c ( l 4) in terms of these arbitrary 
values; and in fact cf } for fixed k and varying i is the arbitrary element 
c (t) plus a determinate function of i depending only on the b i; the a,-/ and 
the solutions of the homogeneous system. On substituting these values 
of the c's into (37) we have the general solution Uj of the non-homogeneous 
system in (36), and hence of system (34). 
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This solution of (34) may obviously be written in the customary form 

(40) Ui = c<M } + c^xf H h c^xf +u it i = 1, 2, ■ ■ ■, n + h, 

where Hi is a particular solution of (34) and the c (1) , • • •, c w are arbitrary 
constants, this form of solution being of course always realized under the 
hypotheses of the first paragraph of the section. 

If we take systems of the form (36) where i runs over the infinite set 
1, 2, 3, • • • instead of the finite set 1, 2, • • • , n, it is easy to see that we have 
a process in every respect identical with the foregoing except that the re- 
currence relations which replace (38) are now to be solved by taking the 
first c?° only (since there is no last), namely c ( /'', as arbitrarily defined. 
Such a system is intimately connected with the theory of difference equa- 
tions. 

Let us now consider the question of adjoining linear conditions to the 
systems (34) and (35), these new conditions to be thought of as being 
analogous to the boundary conditions associated with differential equations 
for instance. Let these new conditions be taken in the forms 

(41) ^ UijUj = hi, 23 a a x i = 0, i = n + 1, n + 2j • • • , n + s, s ^ h. 

The question is on the possibility of choice of the c w in (40) and of the c {k} 
in the relation 

-r ■ = ^dV. 1 ) 4- ... -I- ftWr 1 ." 

so that systems (41) shall be satisfied; that is, it is on the possibility of the 
systems 

h n+h n+h h n+h 

(42) £ c<» D aij xf + Z aauj = hi, Z S (B E aaxf = 0, 

i = n + 1, • • •, n + s. 

In case s < h the latter system always has solutions c w . It may also have 
solutions when s = h. When it has solutions the former system may or 
may not have a solution; its having a solution depends on the character of 
the Uj and hence on the character of the 6,- in (34) and also on the character 
of the new ay and 6, in (41). If s = h and if the last system in (42) has no- 
solution except that for which the c (fc) are all zero then the first system in 

(42) has a unique solution. This last algebraic theorem (essentially obvious 
in its character) has for an analogue a fundamental theorem in the theory 
of differential equations (one which is not obvious in character).* 

Let us now consider the system 

n 

(43) X dijVj = Ci, i = 1, 2, • • •, n, 

^=i 

* B6cher, "Les Methodes de Sturm," pp. 19ff. 
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where the determinant A of the coefficients, A = | oy | , is different from zero. 
Then the customary solution (which is unique) may be written in. the form 

n 

(44) vj = Z) GijCi, j= 1, 2, • • •, n, 

where 

Ay being the cofactor of the element in the ith row and jth column of A. 
The function (?y has been called the Green's function* for the homogeneous 
system 2ay% = corresponding to system (43). For fixed i it satisfies 
every equation of this system except the ith, the first member of the ith 
equation having for this value v 3 - = Ay/A the value 1 instead of zero. Thus, 
by means of the homogeneous system, which is incompatible, we can define 
a Green's function Gy of such sort that the solution of (43) for every set c, 
is expressible in the form (44). If the homogeneous system is not in- 
compatible it is easy to see that no function (?y exists having with respect 
to (43) the named property. 

If Ha is the Green's function of the system adjoint to system (43) in the 
sense of § 2 it is obvious that Hji = Cry. 

This obvious matter for algebraic systems is mentioned here for its 
use in suggesting the requisite procedure for analogous properties of certain 
functional equations to be treated in later papers and especially for its 
use in transforming the expansions of § 4 into the form of contour integrals 
in § 10 immediately following. 

10. Condensation of Algebraic Expansions into Contour Integrals. Let 
us consider systems (10) with a single parameter X and suppose that the 
determinant A(X) of the first system has n distinct simple roots X (1) , X (2) , 
• • • , X (n) and that to each root corresponds a unque solution of the system 
(except for a constant factor). Denote by Ay(X) the cofactor of the element 
in the ith row and jth column of A(X). Then the Green's functions C?y(X) 
and Hij(X) for the two systems in (10) are respectively 

Gy(X) = ~/V\T ' Hij(\) = Gji(K) = a7)T • 

These Green's functions are analytic in the complex variable X except at 
the zeros of A(X), that is, except for characteristic values X w of systems (10). 
Now we may write the Green's function C?y(X) in the forms 

Gijfr) = x ~\w + 8 ki j(K), k = 1, 2, • • •, n, 



*B'6cher, Annals of Mathematics, (2) 13 (1911), pp. 71ff. 
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where Sjt»/(X) is analytic in X at X = X (fc) and Ruj is the residue at 
X = X w of Gn(K) considered as a function of the complex variable X. 
We propose to evaluate the residue Rmj in terms of the solutions of systems 
(10). 

In the first place, we have 

A«(\<*>) 
n " ij A'(X (A;) ) ' 

where A'(X (A;) ) denotes the value at X = X (4) of the derivative of A(X) with 
respect to X. The quantities Xj = Rk a j, for fixed k and <r, afford a solution 
of the first system in (10) for X = X (fc) . Likewise, the quantities y, = R kjp , 
for fixed k and p, afford a solution of the second system in (10) for X = X (fc) ' 
But all solutions of these systems for X = X w are constant multiples of a;^ 
and y ( P respectively. Hence we have 

K'kij IfkXj yi , 

where y k is independent of i and j. It remains to evaluate y k . 
Now we have 

lim {(X - X<»)G„(X) - yaW?) = 0; 

whence it follows that 



(45) lim 

A=\(*> 

But 



(X - X<*>) Z ZGu^bijxf - yaf'Z Zhjxfyf \ = 0. 

i— 1 j=X i=l J=l 



Z (ctj + x& l7 )4- ' = (x - x<*>) Z M 4) » 



so that from the fundamental property of the Green's function we have 

xV =Z<? i( (X)(X-X<*>)£6# 
Putting this value of x ( P into (45) we have readily 

4=1 ^=1 

With the value of Yfc afforded by this relation we have for the residue Rmj 
of Gij(K) at X = X w in the complex plane the value 

(46) ie w = - ^ 



Z Z fe,,*^ > 

p=l <r=l 



From this result we have for the fcth term in the expansion of z t in terms 
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of xV by (16) and (17) the value 

Z Z bjiZiy'f 



«=i j=\ 



i = l > = 1 



n n -i r* n n 

xf = Z HRkjtbjiZi = - — 7== f Z Z O jt (K)bjiZidK, 



where T k is a contour about X w inclosing no other characteristic value of 
system (10). Then, if V is a contour inclosing all the characteristic values 
of systems (10), we have 



(47) 



z t = - — F==r I Z Z) GjtQJbjiZidh, t= 1, 2, • • •, n. 

27r"V— l«/r>=i y=i 



Thus we replace the expansion for z t by a contour integral. It is clear that 
any set of terms of the expansion may likewise be replaced by the same 
integral taken about a contour inclosing appropriate corresponding zeros 
ofA(X). 

Contour integrals of this character were first employed by Birkhoff.* 
They served admirably in the convergence proofs associated with the 
expansions of functions in terms of functions defined by differential systems) 
these systems being of such character as to be realized as limiting cases of 
the algebraic systems here in consideration. We shall find of fundamental 
value in our general investigation various limiting forms of the contour 
integrals developed in this section. 

It is possible (but not- important for our purposes) to modify and extend 
the foregoing analysis so as to avoid the restriction that the zeros of A(X) 
shall be distinct. 

Let us now pass to the more general systems (1) and (2). For any 
given fixed value of h let A h (Xj, X 2 , • • • , X r ) denote the determinant in the 
first member of (3) and let A hij (Xi, X 2 , • • • , X r ) denote the cofactor of the 
element in the ith row and the jth column of this determinant. Then the 
Green's function G h a of the fah system in (1) has the form 

n : — At»j(Xi, X 2 , • • •, X r ) 

Afc(Xl, X,2 ■ ■ ", X r ) 

We assume for the present purpose that systems (1) [and also systems (2)] 
are so restricted that the solution of each for characteristic values of the X's 
is unique (except for a constant factor) and that 

.. Afc(Xl, \<i, ■ • • , X r ) 



\ 1 =\ 1 <- k \ ..., x r =x r «> X/, — \ h 



Ik) 



* Transactions of the American Mathematical Society, 9 (1908) : 373-395. 
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exists and is finite, where V( c) , • • ■ , X'/ J) is any set of characteristic values for 
systems (1) and (2). Then the function 

GmjQ^i , • • • , X;>_i, X;,, Xa + i, • • •, Xi } ) 

of the complex variable \h has a pole of the first order at the point X^ = X* } . 
Let its residue at this point be denoted by Rumj- 

In order to evaluate the residue Rkhij we apply the earlier result of this 
section for Ruj to the system which results from the hth system in (1) on 
replacing each X; except X& by the corresponding characteristic value \fK 
Thus we have 

Rhhn = ihhxfyV 

where jkh is independent of i and j. Then we have 

r r 

where y k is independent of the i and the j. 
Then if we write 

r 
Gilil "• w,(^l) X2, * - ' , Xr) = II GhijjSKl, X2, • * ', Xr) 

we have 

lim (Xx - Xf) • • • (X, - WQu ... v r (Xx, • • • , X r ) = y k f[ *!«; 

x,=V*> x r =y» *=i 

whence it follows that 

(48) lim (Xi - Xf) ■ • ■ (X, - X?') 

x 1=Xl («, .... x r =x r «> 

_»1 Mi W r TC r ?• 

X Z-f ^ * * * 2—1 2-1 ""<!«!■■• irtr^JlH "' 3 r ir i-i-^^h 

= nII<E E---E EDM-^n*M». 

Employing the Ath system in (1) and proceeding by the method used 
earlier in this section for evaluating x { P in terms of the Green's function, 
we have 

r "1, »h 

xf th = Z (X. - X«) Z £ o. fcW ^G MA (Xi, • • • , Xr), A = 1, 2, • • • , r. 



From this we may form the product 

JX) ™W 

and simplify its expression by taking the limit for any convenient approach 
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of Xi, • • • , X r to the characteristic values X^', • • • , X ( *\ Then, in a certain 
range of cases (if not always) it turns out that the value of the product in 
question is that of the first member of equation (48). We confine attention 
to the cases in which this new condition is realized. Then we have 

nj «j n r n r r 

i = yk E Z • • • Z £ *w..M.na4M». 

Thence it follows that 

r 

h=l 



lim (^...^(Xi, • • •, X r ) — -^ si , 

.... ■£-/ ^1< ' " ' 2—1 2—1 " <r\v\ ••• ovpr JL-L X h(r h 1)hp h 

(t) pi=l <ri=l p r =l <r r =l A=l 

From this result we have for the fcth term of the expansion of z tlh ... tr 
afforded by (14) the value 

i r r /• f "i »i «r ». 

7^ J T\r I I • ' ' I L L ••' L L '- > hji...iJr Z hH-ifihh-i r t r 

d\id\2 • • • d\ r , 

where r^ (A = 1, 2, • ■ •, r) is a contour in the X^-plane about the point 

Xi* and containing in its interior no other characteristic value of X&. If 

we replace the contour T^k (h = 1, 2, • • •, r) by I\, a contour which includes 

within it all the characteristic values of X&, and perform the same multiple 

integration about such contours, we shall have the value of the function 

Ztit 2 ...t r - It is clear that we may form similarly the contour integral for 

any given partial sum of the series for z hh \..t r afforded by relation (14). 

University of Illinois, 
September, 1920. 



